Reporting and Description of Research Methodology in Studies Estimating Effects of Firearm Policies.

BACKGROUND: Evidence about which firearm policies work, to what extent, and for whom is hotly debated, perhaps partly because variation in research methodology has produced mixed and inconclusive effect estimates. We conducted a scoping review of firearm policy research in the health sciences in the United States, focusing on methodological considerations for causal inference. METHODS: We identified original, empirical articles indexed in PubMed from 1/1/2000-9/1/2021 that examined any of 18 pre-specified firearm policies. We extracted key study components, including policy type(s) examined, policy operationalization, outcomes, study setting and population, study approach and design, causal language, and whether and how authors acknowledged potential sources of bias. RESULTS: We screened 7733 articles and included 124. A plurality of studies used a legislative score as their primary exposure (n=39; 32%) and did not examine change in policies over time (n=47; 38%). Most examined firearm homicide (n=51; 41%) or firearm suicide (n=40; 32%) as outcomes. One-third adjusted for other firearm policies (n=41; 33%). Three studies (2%) explicitly mentioned that their goal was to estimate causal effects, but over half used language implying causality (n=72; 58%). Most acknowledged causal identification assumptions of temporality (n=91; 73%) and exchangeability (n=111; 90%); other assumptions were less often acknowledged. One-third of studies included bias analyses (n=42; 34%). CONCLUSIONS: We identified a range of methodologic approaches in firearm policy research in the health sciences. Acknowledging limitations of data availability and quality, we identify opportunities to improve causal inferences about and reporting on the effects of firearm policies on population health.

Toward a clearer understanding of what works to reduce gun violence: the role of falsification strategies.

Strong epidemiologic evidence from ecologic and individual-level studies in the United States supports the claim that access to firearms substantially increases the risk of dying by suicide, homicide, and firearm accidents. Less certain is how well particular interventions work to prevent these deaths and other firearm-related harms. Given the limits of existing data to study firearm violence, and the infeasibility of conducting randomized trials of firearm access, it is important to do the best we can with the data we already have. We argue that falsification strategies are a critical - yet underutilized - component of any such analytic approach. The falsification strategies we focus on are versions of "negative controls" analyses in which we expect an analysis should yield a null causal effect, and thus where not obtaining a null effect estimate raises questions about the assumptions underlying causal interpretation of a study's findings. We illustrate the saliency of this issue today with examples drawn from studies published within the last five years in leading peer-reviewed journals. Collecting rich, high-quality data always takes time, urgent as the need may be. On the other hand, doing better with the data we already have can start right now.

Partial Identification of the Effects of Sustained Treatment Strategies.

Although many epidemiologic studies focus on point identification, it is also possible to partially identify causal effects under consistency and the data alone. However, the literature on the so-called "assumption-free" bounds has focused on settings with time-fixed exposures. We describe assumption-free bounds for the effects of both static and dynamic sustained interventions. To provide intuition for the width of the bounds, we also discuss a mathematical connection between assumption-free bounds and clone-censor-weight approaches to causal effect estimation. The bounds, which are often wide in practice, can provide important information about the degree to which causal analyses depend on unverifiable assumptions made by investigators.

Towards a Clearer Causal Question Underlying the Association Between Cancer and Dementia.

BACKGROUND: Several observational studies have described an inverse association between cancer diagnosis and subsequent dementia risk. Multiple biologic mechanisms and potential biases have been proposed in attempts to explain this association. One proposed explanation is the opposite expression of Pin1 in cancer and dementia, and we use this explanation and potential drug target to illustrate the required assumptions and potential sources of bias for inferring an effect of Pin1 on dementia risk from analyses measuring cancer diagnosis as a proxy for Pin1 expression. METHODS: We used data from the Rotterdam Study, a population-based cohort. We estimate the association between cancer diagnosis (as a proxy for Pin1) and subsequent dementia diagnosis using two different proxy methods and with confounding and censoring for death addressed with inverse probability weights. We estimate and compare the complements of a weighted Kaplan-Meier survival estimator at 20 years of follow-up. RESULTS: Out of 3634 participants, 899 (25%) were diagnosed with cancer, of whom 53 (6%) had dementia, and 567 (63%) died. Among those without cancer, 15% (411) were diagnosed with dementia, and 667 (24%) died over follow-up. Depending on the confounding and selection bias control, and the way in which cancer was used as a time-varying proxy exposure, the risk ratio for dementia diagnosis ranged from 0.71 (95% confidence interval [CI] = 0.49, 0.95) to 1.1 (95% CI = 0.79, 1.3). CONCLUSION: Being explicit about the underlying mechanism of interest is key to maximizing what we can learn from this cancer-dementia association given available or readily collected data, and to defining, detecting, and preventing potential biases.

Reporting of Observational Studies Explicitly Aiming to Emulate Randomized Trials: A Systematic Review.

Importance: Observational (nonexperimental) studies that aim to emulate a randomized trial (ie, the target trial) are increasingly informing medical and policy decision-making, but it is unclear how these studies are reported in the literature. Consistent reporting is essential for quality appraisal, evidence synthesis, and translation of evidence to policy and practice. Objective: To assess the reporting of observational studies that explicitly aimed to emulate a target trial. Evidence Review: We searched Medline, Embase, PsycINFO, and Web of Science for observational studies published between March 2012 and October 2022 that explicitly aimed to emulate a target trial of a health or medical intervention. Two reviewers double-screened and -extracted data on study characteristics, key predefined components of the target trial protocol and its emulation (eligibility criteria, treatment strategies, treatment assignment, outcome[s], follow-up, causal contrast[s], and analysis plan), and other items related to the target trial emulation. Findings: A total of 200 studies that explicitly aimed to emulate a target trial were included. These studies included 26 subfields of medicine, and 168 (84%) were published from January 2020 to October 2022. The aim to emulate a target trial was explicit in 70 study titles (35%). Forty-three studies (22%) reported use of a published reporting guideline (eg, Strengthening the Reporting of Observational Studies in Epidemiology). Eighty-five studies (43%) did not describe all key items of how the target trial was emulated and 113 (57%) did not describe the protocol of the target trial and its emulation. Conclusion and Relevance: In this systematic review of 200 studies that explicitly aimed to emulate a target trial, reporting of how the target trial was emulated was inconsistent. A reporting guideline for studies explicitly aiming to emulate a target trial may improve the reporting of the target trial protocols and other aspects of these emulation attempts.

Development of the TrAnsparent ReportinG of observational studies Emulating a Target trial (TARGET) guideline.

BACKGROUND: Observational studies are increasingly used to inform health decision-making when randomised trials are not feasible, ethical or timely. The target trial approach provides a framework to help minimise common biases in observational studies that aim to estimate the causal effect of interventions. Incomplete reporting of studies using the target trial framework limits the ability for clinicians, researchers, patients and other decision-makers to appraise, synthesise and interpret findings to inform clinical and public health practice and policy. This paper describes the methods that we will use to develop the TrAnsparent ReportinG of observational studies Emulating a Target trial (TARGET) reporting guideline. METHODS/DESIGN: The TARGET reporting guideline will be developed in five stages following recommended guidance. The first stage will identify target trial reporting practices by systematically reviewing published studies that explicitly emulated a target trial. The second stage will identify and refine items to be considered for inclusion in the TARGET guideline by consulting content experts using sequential online surveys. The third stage will prioritise and consolidate key items to be included in the TARGET guideline at an in-person consensus meeting of TARGET investigators. The fourth stage will produce and pilot-test both the TARGET guideline and explanation and elaboration document with relevant stakeholders. The fifth stage will disseminate the TARGET guideline and resources via journals, conferences and courses. ETHICS AND DISSEMINATION: Ethical approval for the survey has been attained (HC220536). The TARGET guideline will be disseminated widely in partnership with stakeholders to maximise adoption and improve reporting of these studies.

Falsification of the instrumental variable conditions in Mendelian randomization studies in the UK Biobank.

Mendelian randomization (MR) is an increasingly popular approach to estimating causal effects. Although the assumptions underlying MR cannot be verified, they imply certain constraints, the instrumental inequalities, which can be used to falsify the MR conditions. However, the instrumental inequalities are rarely applied in MR. We aimed to explore whether the instrumental inequalities could detect violations of the MR conditions in case studies analyzing the effect of commonly studied exposures on coronary artery disease risk.Using 1077 single nucleotide polymorphisms (SNPs), we applied the instrumental inequalities to MR models for the effects of vitamin D concentration, alcohol consumption, C-reactive protein (CRP), triglycerides, high-density lipoprotein (HDL) cholesterol, and low-density lipoprotein (LDL) cholesterol on coronary artery disease in the UK Biobank. For their relevant exposure, we applied the instrumental inequalities to MR models proposing each SNP as an instrument individually, and to MR models proposing unweighted allele scores as an instrument. We did not identify any violations of the MR assumptions when proposing each SNP as an instrument individually. When proposing allele scores as instruments, we detected violations of the MR assumptions for 5 of 6 exposures.Within our setting, this suggests the instrumental inequalities can be useful for identifying violations of the MR conditions when proposing multiple SNPs as instruments, but may be less useful in determining which SNPs are not instruments. This work demonstrates how incorporating the instrumental inequalities into MR analyses can help researchers to identify and mitigate potential bias.

Considering Questions Before Methods in Dementia Research With Competing Events and Causal Goals.

Studying causal exposure effects on dementia is challenging when death is a competing event. Researchers often interpret death as a potential source of bias, although bias cannot be defined or assessed if the causal question is not explicitly specified. Here we discuss 2 possible notions of a causal effect on dementia risk: the "controlled direct effect" and the "total effect." We provide definitions and discuss the "censoring" assumptions needed for identification in either case and their link to familiar statistical methods. We illustrate concepts in a hypothetical randomized trial on smoking cessation in late midlife, and emulate such a trial using observational data from the Rotterdam Study, the Netherlands, 1990-2015. We estimated a total effect of smoking cessation (compared with continued smoking) on 20-year dementia risk of 2.1 (95% confidence interval: -0.1, 4.2) percentage points and a controlled direct effect of smoking cessation on 20-year dementia risk had death been prevented of -2.7 (95% confidence interval: -6.1, 0.8) percentage points. Our study highlights how analyses corresponding to different causal questions can have different results, here with point estimates on opposite sides of the null. Having a clear causal question in view of the competing event and transparent and explicit assumptions are essential to interpreting results and potential bias.

Bounding the average causal effect in Mendelian randomisation studies with multiple proposed instruments: An application to prenatal alcohol exposure and attention deficit hyperactivity disorder.

BACKGROUND: As large-scale observational data become more available, caution regarding causal assumptions remains critically important. This may be especially true for Mendelian randomisation (MR), an increasingly popular approach. Point estimation in MR usually requires strong, often implausible homogeneity assumptions beyond the core instrumental conditions. Bounding, which does not require homogeneity assumptions, is infrequently applied in MR. OBJECTIVES: We aimed to demonstrate computing nonparametric bounds for the causal risk difference derived from multiple proposed instruments in an MR study where effect heterogeneity is expected. METHODS: Using data from the Norwegian Mother, Father and Child Cohort Study (n = 2056) and Avon Longitudinal Study of Parents and Children (n = 6216) to study the average causal effect of maternal pregnancy alcohol use on offspring attention deficit hyperactivity disorder symptoms, we proposed 11 maternal SNPs as instruments. We computed bounds assuming subsets of SNPs were jointly valid instruments, for all combinations of SNPs where the MR model was not falsified. RESULTS: The MR assumptions were violated for all sets with more than 4 SNPs in one cohort and for all sets with more than 2 SNPs in the other. Bounds assuming one SNP was an individually valid instrument barely improved on assumption-free bounds. Bounds tightened as more SNPs were assumed to be jointly valid instruments, and occasionally identified directions of effect, though bounds from different sets varied. CONCLUSIONS: Our results suggest that, when proposing multiple instruments, bounds can contextualise plausible magnitudes and directions of effects. Computing bounds over multiple assumption sets, particularly in large, high-dimensional data, offers a means of triangulating results across different potential sources of bias within a study and may help researchers to better evaluate and emphasise which estimates are compatible with the most plausible assumptions for their specific setting.

Partial Identification of the Average Causal Effect in Multiple Study Populations: The Challenge of Combining Mendelian Randomization Studies.

BACKGROUND: Researchers often use random-effects or fixed-effects meta-analysis to combine findings from multiple study populations. However, the causal interpretation of these models is not always clear, and they do not easily translate to settings where bounds, rather than point estimates, are computed. METHODS: If bounds on an average causal effect of interest in a well-defined population are computed in multiple study populations under specified identifiability assumptions, then under those assumptions the average causal effect would lie within all study-specific bounds and thus the intersection of the study-specific bounds. We demonstrate this by pooling bounds on the average causal effect of prenatal alcohol exposure on attention deficit-hyperactivity disorder symptoms, computed in two European cohorts and under multiple sets of assumptions in Mendelian randomization (MR) analyses. RESULTS: For all assumption sets considered, pooled bounds were wide and did not identify the direction of effect. The narrowest pooled bound computed implied the risk difference was between -4 and 34 percentage points. CONCLUSIONS: All pooled bounds computed in our application covered the null, illustrating how strongly point estimates from prior MR studies of this effect rely on within-study homogeneity assumptions. We discuss how the interpretation of both pooled bounds and point estimation in MR is complicated by possible heterogeneity of effects across populations.

Handgun Divestment and Risk of Suicide.

BACKGROUND: Firearm ownership is strongly related to suicide risk, yet little is known about how much risk declines when ownership ends ("divestment"). METHODS: Using data from 523,182 handgun owners, we estimated the effect of divesting and remaining divested versus never divesting on the risk of suicide and firearm-specific suicide. We used pooled logistic regression with inverse probability weighting, adjusting for demographic and area-level measures. RESULTS: The 5-year risk of suicide death was 25.6 (95% confidence interval [CI] = 15.1, 37.2) per 10,000 persons with divestment and 15.2 (95% CI = 13.2, 17.3) per 10,000 persons with no divestment, corresponding to a risk difference of 10.4 (95% CI = 0.7, 21.1) per 10,000 persons. The 5-year risk of firearm-specific suicide death was 6.3 (95% CI = 1.4, 11.9) per 10,000 persons with divestment and 12.9 (95% CI = 11.0, 14.6) per 10,000 persons with no divestment, corresponding to a risk difference of -6.6 (95% CI = -11.4, -0.1) per 10,000 persons. Comparing divestment to no divestment, risks were elevated for deaths due to other causes proposed as negative control outcomes; we incorporated these estimates into a series of bias derivations to better understand the magnitude of unmeasured confounding. CONCLUSIONS: Collectively, these estimates suggest that divestment reduces firearm suicide risk by 50% or more and likely reduces overall suicide risk as well, although future data collection is needed to fully understand the extent of biases such as unmeasured confounding.

Subclinical binge eating symptoms in early adolescence and its preceding and concurrent factors: a population-based study.

OBJECTIVE: Binge eating, loss of control eating and overeating often develop during late childhood or early adolescence. Understanding the presentation of binge eating as early as symptoms manifest and its preceding and concurrent factors is essential to hamper the development of eating disorders. This study examined the prevalence, concurrent and preceding factors (e.g. compensatory behaviors, emotional and behavioral problems) of subclinical binge eating symptoms in early adolescence. METHODS: Data from the population-based Generation R Study were used (n = 3595). At 10 years and 14 years, preceding and concurrent factors including eating behaviors, body dissatisfaction, emotional and behavioral problems and body composition were assessed. At 14 years, 3595 adolescents self-reported on binge eating symptoms in the past 3 months and were categorized into four groups: no symptoms (n = 3143, 87.4%), overeating only (n = 121, 3.4%), loss of control (LOC) eating only (n = 252, 7.0%) or binge eating (i.e. both, n = 79, 2.2%). RESULTS: In total, 452 (12.6%) young adolescents reported subclinical binge eating symptoms. Those who reported LOC eating and binge eating showed most compensatory behaviors (e.g. hide or throw away food, skipping meals). Concurrent emotional and behavioral problems, body dissatisfaction, more emotional-, restrained- and uncontrolled eating, and a higher BMI were associated with subclinical binge eating symptoms. Preceding self-reported emotional and behavioral problems, body dissatisfaction, more restrained eating and higher BMI (both fat mass and fat-free mass) at 10 years were associated with LOC eating and binge eating, but not with overeating. DISCUSSION: Among young adolescents, subclinical binge eating symptoms were common. Considering the high prevalence of LOC eating, and the overlapping preceding and concurrent factors of LOC eating and binge eating compared to overeating, LOC eating seems to be a key symptom of binge eating in early adolescence.

Binge eating (an episode of overeating together with a feeling of loss of control) is a common symptom of most eating disorders and often emerges during late childhood or early adolescence. Examining the presentation of subclinical binge eating symptoms (overeating, loss of control eating and binge eating) during this period and identifying potential risk factors can help to hamper the development of eating disorders. This study in a community sample of young adolescents showed that subclinical binge eating symptoms were common, as these were reported by 12.6% of adolescents, of which loss of control eating only was most common (7%). Unhealthy eating behaviors, poor mental health and higher weight were associated with binge eating symptoms. Prevention strategies may interrupt the development of binge eating by focusing on LOC eating and its risk factors.

Prenatal exposure to trans fatty acids and head growth in fetal life and childhood: triangulating confounder-adjustment and instrumental variable approaches.

Dietary trans fatty acids (TFAs) are primarily industrially produced and remain abundant in processed food, particularly in low- and middle-income countries. Although TFAs are a cause of adverse cardiometabolic outcomes, little is known about exposure to TFAs in relation to brain development. We aimed to investigate the effect of maternal TFA concentration during pregnancy on offspring head growth in utero and during childhood. In a prospective population-based study in Rotterdam, the Netherlands, with 6900 mother-child dyads, maternal plasma TFA concentration was assessed using gas chromatography in mid-gestation. Offspring head circumference (HC) was measured in the second and third trimesters using ultrasonography; childhood brain morphology was assessed using magnetic resonance imaging at age 10 years. We performed regression analyses adjusting for sociodemographic and lifestyle confounders and instrumental variable (IV) analyses. Our IV analysis leveraged a national policy change that led to a substantial reduction in TFA and occurred mid-recruitment. After adjusting for covariates, maternal TFA concentration during pregnancy was inversely related to fetal HC in the third trimester (mean difference per 1% wt:wt increase: - 0.33, 95% CI - 0.51, - 0.15, cm) and to fetal HC growth from the second to the third trimester (- 0.04, 95% CI - 0.06, - 0.02, cm/week). Consistent findings were obtained with IV analyses, strengthening a causal interpretation. Association between prenatal TFA exposure and HC in the second trimester or global brain volume at age 10 years was inconclusive. Our findings are of important public health relevance as TFA levels in food remain high in many countries.

Iron, folic acid, and multiple micronutrient supplementation strategies during pregnancy and adverse birth outcomes in Botswana.

BACKGROUND: Antenatal multiple micronutrient supplementation (MMS) with iron, folic acid, and other micronutrients might improve birth outcomes, but it is not currently universally recommended by WHO. METHODS: In this observational cohort study, we surveyed pregnancies for adverse birth outcomes at eight hospitals from July, 2014, to July, 2018, and 18 hospitals from August, 2018, to December, 2020, in Botswana to assess four routine supplementation strategies in women presenting before 24 weeks' gestation: folic acid only, iron only, iron and folic acid supplementation (IFAS), and MMS. Women with singleton pregnancies; a known HIV status, age, and delivery site; haemoglobin measured within 7 days of presenting to antenatal care; and weight measured within 31 days of presenting to care were included in our analysis. Data were abstracted from the maternity obstetric record (a record of antenatal care) at the time of birth from all women giving birth at selected hospitals throughout the country. We estimated risk differences overall and in key subgroups, adjusting for demographic and clinical factors. FINDINGS: Between July 6, 2014, and Dec 8, 2020, 96 341 eligible women (21 659 [22·5%] of whom had HIV) were included in the study. 36 334 (37·7%) women initiated iron only supplementation, 1133 (11·8%) initiated folic acid only supplementation, 23 101 (24·0%) initiated IFAS, and 31 588 (32·8%) women initiated MMS. Women who initiated iron only and folic acid only supplementation had higher risks of stillbirth, preterm birth, very preterm birth, low and very low birthweight, and neonatal death compared with women who received IFAS (adjusted risk differences for iron only supplementation vs IFAS ranged from 0·22% [95% CI 0·04 to 0·40] for neonatal death to 2·39% [1·78 to 3·00] for preterm birth; and adjusted risk differences for folic acid only supplementation vs IFAS ranged from 0·77% [-0·80 to 2·34] for neonatal death to 5·75% [1·38 to 10·13] for preterm birth), with greater difference in women with HIV and those aged 35 years and older. Compared with IFAS, women who initiated MMS had lower risks of preterm and very preterm births, and low and very low birthweight (adjusted risk differences ranged from -0·50% [-0·77 to 0·23] for very preterm birth to -1·06% [-1·69 to -0·42] for preterm birth). INTERPRETATION: Nationwide data from Botswana support improved birth outcomes with MMS compared with IFAS. FUNDING: National Institutes of Health, National Institute of Child Health and Human Development, and National Institute of Allergy and Infectious Diseases.

Invited Commentary: Conducting and Emulating Trials to Study Effects of Social Interventions.

All else being equal, if we had 1 causal effect we wished to estimate, we would conduct a randomized trial with a protocol that mapped onto that causal question, or we would attempt to emulate that target trial with observational data. However, studying the social determinants of health often means there are not just 1 but several causal contrasts of simultaneous interest and importance, and each of these related but distinct causal questions may have varying degrees of feasibility in conducting trials. With this in mind, we discuss challenges and opportunities that arise when conducting and emulating such trials. We describe designing trials with the simultaneous goals of estimating the intention-to-treat effect, the per-protocol effect, effects of alternative protocols or joint interventions, effects within subgroups, and effects under interference, and we describe ways to make the most of all feasible randomized trials and emulated trials using observational data. Our comments are grounded in the study results of Courtin et al. (Am J Epidemiol. 2022;191(8):1444-1452).

Suicide Deaths Among Women in California Living With Handgun Owners vs Those Living With Other Adults in Handgun-Free Homes, 2004-2016.

Importance: Little is known about the extent to which secondhand exposure to household firearms is associated with risk of suicide in adults who do not own guns, most of whom are women. Objective: To evaluate changes in risk of suicide among women living in gun-free households after one of their cohabitants became a handgun owner. Design, Setting, and Participants: This cohort study observed participants for up to 12 years and 2 months from October 18, 2004, to December 31, 2016. Data were analyzed from April to November 2021. The study population included 9.5 million adult women in California who did not own guns and who entered the study while living with 1 or more adults in a handgun-free home. Exposures: Secondhand exposure to household handguns. Main Outcomes and Measures: Suicide, firearm suicide, nonfirearm suicide. Results: Of 9.5 million women living in handgun-free homes, 331 968 women (3.5% of the study population; mean [SD] age, 41.6 [18.0] years) became exposed to household handguns during the study period. In the entire study population, 294 959 women died: 2197 (1%) of these were by suicide, 337 (15%) of which were suicides by firearm. Rates of suicide by any method during follow-up were higher among cohort members residing with handgun owners compared with those residing in handgun-free homes (hazard ratio, 1.43; 95% CI, 1.11-1.84). The excess suicide rate was accounted for by higher rates of suicide by firearm (hazard ratio, 4.32; 95% CI, 2.89-6.46). Women in households with and without handguns had similar rates of suicide by nonfirearm methods (hazard ratio, 0.90; 95% CI, 0.63-1.27). Conclusions and Relevance: In this study, the rate of suicide among women was significantly higher after a cohabitant of theirs became a handgun owner compared with the rate observed while they lived in handgun-free homes.

Patterns of handgun divestment among handgun owners in California.

BACKGROUND: Little is known about voluntary divestment of firearms among US firearm owners. Here, we aim to estimate the proportion of handgun owners who divest their handguns in the years following their initial acquisition; examine the timing, duration, and dynamics of those divestments; and describe characteristics of those who divest. METHODS: We use data from the Longitudinal Study of Handgun Ownership and Transfer, a cohort of registered voters in California with detailed information on 626,756 adults who became handgun owners during the 12-year study period, 2004-2016. For the current study, persons were followed from the time of their initial handgun acquisition until divestment, loss to follow-up, death, or the end of the study period. We describe the cumulative proportion who divest overall and by personal and area-level characteristics. We also estimate the proportion who reacquired handguns among persons who divested. RESULTS: Overall, 4.5% (95% CI 4.5-4.6) of handgun owners divested within 5 years of their first acquisition, with divestment relatively more common among women and among younger adults. Among those who divested, 36.6% (95% CI 35.8-37.5) reacquired a handgun within 5 years. CONCLUSIONS: Handgun divestment is rare, with the vast majority of new handgun owners retaining them for years.